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PREFACE 


To  some,  this  thesis  may  be  regarded  as  an  exercise  in  futility. 

To  capture  the  essence  of  uncertainty  is  to  assume  all  knowledge.  A 
prediction  is  just  that  - a prediction.  Only  time  can  lay  bare  the  truth. 
No  model  for  the  future  will  ever  become  reality.  All  models  are  false. 
They  are  not  the  real  world  and  will  never  predict  the  real  world  with 
certainty.  Why  then  should  one  attempt  to  predict  the  future?  To  not 
attempt  to  model  the  future  is  fools  play.  In  our  complex  society  all 
alternatives,  all  sources  of  knowledge  must  be  explored.  Although  the 
prediction  may  be  wrong,  it  is  the  process  of  arriving  at  the  prediction 
that  is  important.  The  process  allows  one  an  understanding  of  the  com- 
plexities of  the  variables  and  interactions.  Knowledge  of  these  complex- 
ities and  interactions  illuminates  the  alternatives  and  allows  one  to 
shape  the  future  in  the  direction  of  the  prediction.  In  combating  the 
future,  any  weapon  is  preferable  to  no  weapon  at  all. 

I wish  to  express  my  appreciation  to  my  adviser,  Keith  Womer,  for 
his  kind  patience  and  brotherly  guidance  and  my  reader,  Jim  Dunn,  for  his 
time  and  careful  consideration.  I also  wish  to  thank  my  typist.  Eve 
Vaught.  Most  of  all,  I wish  to  thank  my  wife,  Nancy,  for  her  love  and 
understanding  throughout  the  preparation  of  this  thesis. 

The  responsibility  for  any  errors,  omissions,  or  misrepresentations 
in  this  thesis  is,  of  course,  mine.  


John  A.  Long 
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ABSTRACT 


\ 


n recent  years,  men  and  governments  have  become  keenly  aware  of 
the  huge  capital  outlays  necessary  in  the  acquiring  of  new  weapons  sys- 
tems. Increased  burden  on  limited  capital  has  required  more  complete 
and  careful  planning.  This  planning  has  led  to  the  need  for  accurate 
and  timely  cost  predictions  of  new  systems. 

Historically,  the  variables  affecting  the  future  cost  of  aircraft 
airframes  have  been  proven  to  be  airframe  weight  and  aircraft  speed. 

These  are  often  combined  with  a learning  hypothesis  to  form  an  airframe 
cost  model.  In  this  paper,  the  production  function  of  microeconomics  is 
combined  with  weight,  speed,  and  learning  to  form  a nonlinear  cost  esti- 
mation model . 

t 

Nonlinear  least  squares  regression  analysis  was  used  in  evaluating 
this  model.  Although  the  results  are  inconclusive,  based  on  the  data 
used,  weight  and  speed  combined  with  learning  still  appear  to  be  the  best 
predictors  of  aircraft  airframe  cost. 


vi 


I.  INTRODUCTION 


The  accounting  for  and  control  of  future  expenditures  are  matters 
of  great  concern  and  Importance.  It  is  becoming  more  and  more  important 
for  industry  and  government  to  obtain  good  cost  estimates  of  future  pro- 
ducts and  systems.  Cost  estimation  and  prediction  are  nowhere  more  evi- 
denced than  in  the  Department  of  Defense.  Today's  peacetime  military 
establishment  is  faced  with  ever  increasing  budgetary  demands  and  con- 
straints. Rising  inflation,  coupled  with  greater  future  uncertainty,  has 
compounded  the  difficult  task  of  cost  prediction.  Cost  overruns  and  can- 
celled projects  have  become  a way  of  life.  For  these  reasons,  greater 
emphasis  is  being  placed  on  prediction  models  and  predictive  accuracy. 
This  thesis  is  an  attempt  to  shed  additional  light  on  this  essential,  yet 
frustrating,  area  of  concern. 

A major  part  of  the  defense  budget  is  spent  on  the  acquisition  of 
new  weapons  systems.  In  the  Air  Force  these  expenditures  often  take  the 
form  of  new  airframes.  It  is  in  this  area  that  this  thesis  will  have  its 
concentration. 

THREE  APPROACHES 

Basically,  there  are  three  methods  of  estimating  the  acquisition 
costs  of  new  weapons  systems.  These  are  the  Industrial  engineering 
approach,  the  analogy  approach,  and  the  statistical  estimation  or  para- 
metric approach.  Each  approach  has  Its  own  advantages  and  disadvantages. 

The  Industrial  engineering  approach  defines  the  engineering  tasks, 
tool  requirements  and  labor  requirements  at  a low  task  level  and  then 
applies  work  standards  to  obtain  estimates  for  labor  hours,  material 


usage,  etc.  These  estimates  are  then  aggregated  to  provide  a total  pro- 
j r . gram  cost.  This  is  sometimes  referred  to  as  "grass  roots"  estimating 

(Batchelder,  et  al,  1969:2). 

The  disadvantages  of  this  approach  outweigh  the  advantages,  par- 
ticularly in  the  aerospace  industry.  First,  the  aerospace  industry  does 
not  apply  standards  on  a wide  scale  basis.  Many  standards  are  non- 
existent and  must  be  estimated.  Rapid  technological  change  makes  many 
standards  obsolete  and  unusable. 

Secondly,  standards  are  best  applied  where  long,  stable  production 
runs  are  used.  This  is  not  a characteristic  of  the  aerospace  industry. 

Thirdly,  this  approach  requires  more  personnel,  data,  and  time  than  the 
other  approaches.  Using  this  approach  requires  as  many  as  4500  estimates 
per  airframe  (Batchelder,  et  al,  1969:5).  Lastly,  for  many  purposes, 
industrial  engineering  estimates  have  been  found  to  be  less  accurate 
than  those  made  statistically  (Batchelder,  et  al,  1969:5).  This  approach 
is  best  used  in  the  latter  stages  of  development  when  engineering  studies 
have  been  made  and,  perhaps,  some  components  or  prototypes  built. 

The  analogy  approach  attempts  to  compare  a previous  system  with  a 
planned  system  and  by  contrasting  similarities  and  differences  a cost 
estimate  for  the  new  system  is  obtained.  The  analogy  approach  is  used 
in  the  aerospace  industry  quite  often  since  a firm's  knowledge  of  pro- 

t 

duction  requirements  and  costs  Is  usually  limited  to  its  own  history. 

This  approach  requires  a great  deal  of  judgment  and  relies  on  past  ex- 
perience and  expertise  to  arrive  at  a satisfactory  cost  estimate.  It  is 
most  useful  when  the  future  product  Is  essentially  the  same  as  that  of 
the  past  or  present  period. 
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The  parametric  cost  estimating  approach  uses  statistical  theory 
to  relate  historical  data  on  past  system  costs  to  future  system  costs. 
Parametric  models  are  designed  to  be  used  at  a time  when  very  little 
is  known  about  the  aircraft  (Large,  et  al,  1977:1).  This  approach  is 
widely  used,  as  are  the  others,  by  government  and  industry  and  will  con- 
stitute the  basis  for  this  study.  It  is  best  applied  in  the  conceptual 
stages  of  a new  system  when  the  least  is  known  about  that  system. 

In  applying  the  parametric  approach,  cost  estimating  relationships 
(CER's)  that  will  accurately  predict  future  weapons  systems  costs  are 
developed.  The  procedure  is  to  decide  what  variables  are  logically  or 
theoretically  related  to  cost  and  then  to  look  for  patterns  in  the  data 
which  suggest  a relationship  between  cost  and  the  variables  (Batchelder, 
et  al,  1969:34).  The  variables  can  be  related  to  cost  in  a "causation" 
cost  model  or  a "correlation"  cost  model.  This  distinction  can  be  im- 
portant. Both  models  have  the  property  that  cost  = f (characteristics) 
but  only  a causation  model  can  be  transformed  where  characteristics  = f”^ 
(cost).  Confusing  the  two  can  lead  to  erroneous  and  embarrassing  results 
(Batchelder,  et  al , 1969:57).  The  parametric  cost  approach  must  not  be 
used  blindly  but  must  be  tempered  with  experience  and  understanding. 
Estimating  relationships  can  only  be  derived  from  historical  data,  and 
the  past  is  not  always  a reliable  guide  to  the  future. 

HISTORY  OF  CER  DEVELOPMENT 

Since  World  War  II,  major  emphasis  has  been  placed  on  airframe 
cost  analysis  and  prediction.  Most  early  studies  concluded  that  three 
factors,  weight,  speed,  and  quantity,  best  explained  the  variations  in 
cost  among  airframes.  Weight  is  given  as  AMPR  weight  and  is  defined  in 


the  Aeronautical  Manufacturers*  Planning  Report  as 

"the  empty  weight  of  the  airplanes  less  (1)  wheels,  brakes, 
tires,  and  tubes,  (2)  engines,  (3)  starter,  (4)  cooling 
fluid,  (5)  rubber  or  nylon  fuel  cells,  (6)  instruments, 

(7)  batteries  and  electrical  power  supply  and  conversion 
eauipment,  (8)  electronic  equipment,  (9)  turret  mechanism 
and  power  operated  gun  mounts,  (10)  remote  fire  mechanism 
and  sighting  and  scanning  equipment,  (11)  air-conditioning 
units  and  fluid,  (12)  auxiliary  power  plant  unit,  (13) 
trapped  fuel  and  oil." 

Speed  is  maximum  speed  in  knots  at  best  altitude. 

A 1971  Rand  Corporation  study  (Levenson,  et  al,  1971)  provided 

separate  estimating  equations  for  engineering,  development  support, 

flight  test  material,  and  quality  control.  This  study  concluded  that: 

"The  most  useful  regression  equations  are  exponential  in 

form, It  was  found  from  empirical  investigation  and  past 

experience  that  only  three  basic  variables  — aircraft  quan- 
tity, speed,  and  AMPR  weight  --  provide  the  most  useful  re- 
lationships for  most  of  the  cost  elements.  A fourth  variable, 
production  rate,  was  used  with  the  tooling  equation.  Little 
or  no  predictive  Improvement  is  gained  by  including  additional 
physical  and  performance  variables,  by  fitting  more  compli- 
cated functions,  or  by  incorporating  other  characteristics 
(quantitative  or  qualitative)  of  these  procurement  programs." 
(Levenson,  et  al,  1971:2-3). 

This  seems  like  too  simplistic  an  explanation  to  such  a complicated 
problem  as  airframe  cost  prediction.  Therefore,  Rand  Corporation  under- 
took additional  studies.  With  a broadened  data  base  and  more  sophisti- 
cated prediction  techniques,  a follow-on  study  was  published  in  1976 
(Large,  et  al,  1976).  In  this  study  all  the  characteristics  below  were 
considered:  (Large,  et  al,  1976:12) 

- weight 

- speed 

- ceiling 

- climb  rate 

- range  factor 

- thrust-to-weight  ratio 

- wing  loading 

- aspect  ratio 
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- static  thrust 

- lift-to-drag  ratio 

- load  factor 

- wetted  area 

- ratio  of  gross  takeoff  weight  to  airframe  unit  weight 

- wing  area 

- empty  weight  minus  structure  weight 

- ratio  of  wetted  area  to  stress  design  weight 

- ratio  of  wetted  area  to  wing  area 

This  report  states, 

"A  determined  effort  was  made... to  find  additional  character- 
istics that  would  make  an  estimating  model  more  flexible  and 
hence  better  able  to  deal  with  characteristics  peculiar  to 
individual  aircraft.  That  effort  was  not  productive.  The 
variations  in  cost  that  are  not  explained  by  weight  and  speed 
are  not  explained  by  any  other  objective  parameters  tested." 

(Large,  et  al , 1 976: V ) 

In  a separate  study,  production  rate  and  production  cost,  were  con- 
sidered (Large,  et  al , 1974).  Production  rate  seems  a logical  variable 
since  high  production  rates  allow  greater  use  of  facilities  and  greater 
labor  specialization.  Materials  can  be  purchased  in  larger  quantities 
and  inventoried  for  shorter  periods.  Additionally,  increased  production 
reduces  overhead  rates.  This  study  concluded,  however,  that  the  effect 
of  production  rate  on  manufacturing  labor,  manufacturing  materials,  tool- 
ing, and  engineering  cannot  be  predicted  with  confidence.  These  findings 
may  have  been  influenced  by  the  fact  that  past  decisions  on  production 
rate  were  based  on  military,  financial,  and  political  considerations  and 
not  on  efficiency  of  production. 

LEARNING 


The  effect  of  the  learning  curve  on  airframe  production  costs  was 
recognized  and  applied  prior  to  World  War  II.  Variously  called  learning, 
progress,  improvement  or  experience  curves,  the  principle  of  learning,  as 
set  forth  by  T.P.  Wright  in  1936,  states  that  as  the  total  quantity  of 
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units  produced  doubles,  the  cost  per  unit  declines  by  some  constant  per- 
centage. The  term  "cost  per  unit"  may  apply  to  the  average  cost  of  a 
given  number  of  units  in  which  case  a "cumulative  average  learning 
curve"  is  referenced  or  the  term  "cost  per  unit"  may  apply  to  the  cost 
of  a specific  unit  in  which  case  a "unit  learning  curve"  is  referenced. 
As  an  example,  if  the  average  cost  of  producing  200  units  is  80  percent 
of  the  average  cost  of  producing  the  first  100  units,  an  80  percent  cum- 
ulative average  learning  curve  ie  established.  If,  on  the  other  hand, 
the  cost  of  producing  the  200th  unit  is  80  percent  of  the  cost  of  pro- 
ducing the  100th  unit,  then  a unit  learning  curve  is  presented. 

Most  learning  is  associated  with  labor  learning  and  the  increased 
productivity  of  labor  as  a result  of  repetition.  While  this  factor  may 
be  most  important,  other  factors  contribute  to  this  phenomenon.  These 
include  (Batchelder,  et  al,  1969:94): 

1.  General  improvement  in  tool  coordination,  shop  organi- 
zation, and  engineering  liaison. 

2.  Development  of  more  efficiently  produced  subassemblies. 

3.  Development  of  more  efficient  parts-supply  system. 

4.  Development  of  more  efficient  tools. 

5.  Substitution  of  cast  or  forged  components  for  machined 
components. 

6.  Improvement  in  overall  management. 

Simply  stated,  the  learning  hypothesis  states  that  as  quantity 
goes  up,  cost  goes  down.  Mathematically,  this  can  be  represented  by  a 
power  (log-linear)  equation  of  the  form 

c = axb 

where 


a = cost  of  first  unit  produced 
x = number  of  units 

b = exponent  measuring  the  slope  of  the  learning  curve. 

PRODUCTION  FUNCTION  MODEL 

Another  way  to  view  cost  estimation  is  through  the  production 
function  as  set  forth  in  microeconomics.  Many  estimated  cost  functions 
begin  with  a Cobb-Douglas  production  function  that  explains  costs  in 
accordance  with  the  theory  of  the  single  firm.  A generalized  Cobb- 
Douglas  production  function  which  considers  only  two  categories  of 
input  - capital  and  labor  - appears  in  the  form 

q = aKeiLez 

This  function  is  homogeneous  of  degree  ej  + 62*  This  sum  also  defines 
the  returns  to  scale  parameter.  Returns  to  scale  describe  the  change  in 
output  to  a proportionate  change  in  input.  Returns  to  scale  may  be  con- 
stant, increasing  or  decreasing.  If  output  and  input  change  in  the  same 
proportion,  returns  to  scale  are  constant  and  the  function  is  homogeneous 
of  degree  one.  If  output  increases  at  a faster  rate  than  input,  in- 
creasing returns  to  scale  are  evidenced  and  the  function  is  homogeneous 
of  degree  greater  than  one.  Similarly,  if  output  increases  at  a slower 
rate  than  input,  the  production  function  exhibits  decreasing  returns  to 
scale  and  homogeneity  is  less  than  one.  A production  function  over  its 
entire  range  may  experience  all  these  cases  of  returns  to  scale. 

This  generalized  Cobb-Douglas  production  function  can  be  augmented 
with  the  learning  hypothesis  and  time  value  of  money  concept  to  derive  a 
cost  estimating  model. 


WOMER  MODEL 
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While  past  empirical  studies  conclude  that  production  rate  contri- 
butes little  explanatory  value  to  a CER,  economic  models  of  the  pro- 
duction to  order  variety  frequently  conclude  that  production  rate  does 
influence  unit  cost.  Womer  has  developed  a model  which  allows  production 
rate  to  be  a decision  variable  in  the  contractors'  production  planning. 
This  model  provides  for  changes  in  production  rate  as  the  program  pro- 
gresses, thereby  optimizing  the  production  plan.  This  model  forms  the 
basis  for  this  thesis  effort. 

The  development  of  the  model  begins  with  a production  function  of 
the  form 

o<‘>  ■ A Q(t)  XU)  0) 

where 

q(t)  = output  rate  of  the  program  at  t 

A = a constant 

Q(t)  = JQt q(t)dt  * cumulative  production  experience  at  t 
x(t)  = rate  of  resource  use  at  t 
<5  = a parameter  describing  learning 

a = a return  to  scale  parameter 

Solving  (1)  for  x(t)  and  dividing  by  q(t)  gives 

X(t)/q(t)  = A"aq(t)a_1  (2) 

Next,  considering  Input  prices  and  the  discount  rate  to  be  exogen- 
ous variables,  a program  cost  Is  determined  by 

c “ J0T  X(t)e‘ptdt 


. If  ^ 


•V:AJ.£ri?  ~ 73J  TH 

, • ' *2 


(3) 


where 


C = discounted  program  cost 

T = total  length  of  the  production  period 
x(t)  = rate  of  resource  use  at  t 
p = discount  rate 

(The  present  value  concept  is  incorporated  by  use  of  the  continuous  dis- 
count factor  e"pt,  where  p is  the  discount  rate  (Dunne,  1975:11).  Com- 
bining (1)  and  (3)  leads  to  a problem  in  optimal  control  (Intri legator, 
1971:292-304)  characterized  as 

min  J0T  X(t)e"ptdt 

St  q(t)  = A Q*tj  xJ/j 

x(t)  = 0 Q(0)  = 0 Q(T)  = V 

where 

T = total  length  of  the  production  period 

x(t)  = rate  of  resource  use  at  t 

p = discount  rate 

q(t)  = output  rate  of  the  program  at  t 

A = a constant 

Q(t)  = cumulative  production  experience  at  t 
6 = a parameter  describing  learning 

a = a return  to  scale  parameter 
V = volume  of  output  produced  by  T 
After  an  appropriate  transformation,  several  substitutions  and  mathemat- 
ical operations  (Vlomer, . . . . :4-6),  the  total  discounted  cost  of  the  pro- 
gram in  terms  of  V and  T Is 
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mss 


i* 


(4) 


C ( V , T ) = [p/(c»-l  )]<x'1  (1 AVa(l"6)[epT/(a'l)-l]1'a 

Integrating  (4)  from  0 to  t where  t<T  yields 

C(t/V,T)  = [p/(a-l)]a'1(l-s)'0tAV0t(l"6)[epT/(a"l)-l]_a[ept/(a’l)-l]  (5) 

which  is  the  time  path  of  cumulative  discounted  cost  given  V and  T. 

Womer  refers  to  (4)  as  the  planning  situation  and  (5)  as  the  production 
situation.  Equation  (4)  is  used  in  planning  to  determine  optimal  levels 
for  volume  and  time.  In  Equation  (5)  volume  and  time  are  given.  Thus 
the  cost  at  any  time,  t,  can  be  determined. 

After  an  appropriate,  simplifying  substitution  (Womer. .. :7) , (5) 
is  changed  to  read 

C(t/V,T)  = [p/(a-l)]a“1(l-6)'aAV(a"l)(l"6)[Q(t)]1-6[epT/(a'l)-l]1“a  (6) 

This  model  joins  the  concept  of  learning  to  the  production  function. 
Implicit  in  the  use  of  this  model  are  the  following  assumptions: 

- The  production  function  is  homogeneous. 

- The  contractor  experiences  decreasing  returns  to  scale. 

- The  contractor  experiences  learning  by  doing. 

- Prices  of  resources  are  fixed. 

- The  contractor  has  flexibility  in  resource  use. 

- The  program  is  defined  by  volume  of  output  (V)  available  at 
time  (T). 

- The  contractor  has  no  prior  production  experience. 

- The  goal  is  to  minimize  the  discounted  cost  of  producing 
volume  V at  time  T. 

The  model  presented  here  and  several  variations  as  derived  in  Chap- 
ters II  and  IV  will  be  augmented  with  the  traditional  CER  variables  of 
weight  and  speed  and  it  is  these  augmented  forms  of  the  model  that  are 
used  for  the  analysis  in  this  thesis. 
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The  objective  of  this  thesis  is  to  determine  if  the  Womer  model  is 
significantly  better  in  explaining  and  predicting  aircraft  airframe 
costs  than  the  more  simple  models  of  Large  and  Levenson  which  contain 
only  weight,  speed,  and  quantity  as  decision  variables.  In  meeting  this 
objective,  data  was  gathered  on  a selected  group  of  aircraft.  Using  the 
data,  nonlinear  least  squares  regression  analysis  was  used  to  determine 
values  for  the  unknown  parameters  in  the  model.  These  parameters  were 
tested  for  statistical  significance  and  the  predictive  ability  of  the 
model  was  determined.  The  findings  can  be  found  in  the  conclusion  of 
this  thesis. 

Dunne,  in  1975,  attempted  the  first  validation  of  the  Womer  model. 
His  study,  however,  fell  short  of  its  objective  in  two  areas.  First, 
appropriate  values  for  volume  and  time,  as  specified  in  the  model,  could 
not  be  obtained.  He  used  actual  volume  and  time  in  place  of  planned  vol- 
ume and  time.  Secondly,  he  was  unable  to  use  nonlinear  least  squares 
regression  in  his  analysis.  He,  therefore,  transformed  the  Womer  model 
into  a form  that  could  be  analyzed  linearly,  and,  in  doing  so,  some  of 
the  original  meaning  of  the  model  was  lost.  This  study  overcomes,  to  a 
large  extent,  the  two  problems  encountered  by  Dunne. 

Chapter  II  contains  the  methodology  of  this  thesis  including  treat- 
ment of  the  data  base  and  method  of  solution.  Chapter  III  is  a review  of 
the  statistical  methods  used  in  the  analysis  which  is  contained  in  Chap- 
ter IV.  Chapter  V deals  with  the  problem  of  model  validity  and  Chapter 
VI  contains  concluding  remarks. 
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II.  METHODOLOGY 


DATA  BASE 

Data  is  the  essence  of  any  analysis.  The  data  can  greatly  affect 
the  outcome  and,  therefore,  should  be  picked  with  care.  Far  too  often, 
however,  the  data  required  has  not  been  collected  or  is  not  available. 

In  such  cases,  less  than  ideal  data  must  be  used.  The  use  of  such  data, 
or  any  data  for  that  matter,  for  production  studies  or  economic  predictions 
raises  questions  of  comparability  and  consistency  (Dunne,  1975:15). 

To  further  complicate  the  collection  of  data,  accounting  practices 
differ  between  companies,  and  even  in  the  same  company  over  a period  of 
time.  Additionally,  terminology  and  methods  of  data  collection  are  not 
standardized. 

With  these  problems  and  complications  in  mind,  an  attempt  must  be 
made  to  reconcile  the  discrepancies  and  gather  the  best  available  data, 
bearing  in  mind  the  limitations  of  that  data. 

First,  the  items  of  data  needed  must  be  determined.  These  items 
are  dictated  by  the  model  and  include  program  cost  (C ( t ) ) , cumulative 
production  experience  at  time  t (Q),  time  horizon  for  the  production  pro- 
gram (T),  and  volume  of  output  to  be  produced  by  T (V).  Additionally, 
the  AMPR  weight  (W)  and  speed  (S)  of  each  aircraft  will  be  needed. 

Having  determined  the  items  of  data  needed,  the  aircraft  to  include 
in  the  data  base  must  be  chosen.  The  data  base  was  originally  planned  to 
consist  of  the  sixteen  aircraft  listed  In  Table  I.  These  aircraft  con- 
stitute a somewhat  homogeneous  set  in  that  they  are  jet  aircraft  employ- 
ing post  World  War  II  technology.  They  range  In  speed  from  578  knots  to 
1,262  knots  and  weigh  from  5,072  pounds  to  32,458  pounds. 
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TABLE  I 


Aircraft  in  Original  Data  Base 


A-3 

A-7 

F^51 

F-106 

A-4 

F-4 

F-102 

F-m 

A-5 

F-14 

F-104 

T-38 

A-6 

F-100 

F-105 

T-39 

With  the  specific  data  requirements  in  mind,  a search  for  the  nec- 
essary data  was  conducted.  No  single  source  contains  all  the  data  desired. 
A possible  source  considered  was  the  airframe  contractors.  A letter  was 
sent  to  all  the  contractors  involved  requesting  their  planned  production 
schedule  at  the  time  the  first  production  contract  was  signed.  Those 
contractors  contacted  and  their  respective  airframes  were  Fairchild 
Republic  Company  (A-10,  F-105),  General  Dynamics  Convair  Division  (F-102, 
F-106),  General  Dynamics  Fort  Worth  Division  (F-lll),  Grumman  Aerospace 
Corporation  (A-6,  F-14),  Lockheed  Aircraft  Corporation  (F-104),  McDonnell 
Douglas  Corporation  (A-3,  A-4,  F-4,  F-15),  Northrup  Corporation  (T-38), 
Rockwell  International  Corporation  (A-5,  F-100,  T-39),  and  Vought  Corp- 
oration (A-7).  A sample  letter  is  included  as  Appendix  A to  this  thesis. 

Response  to  these  letters  was  less  than  encouraging.  In  many 
cases,  either  no  data  was  received  or  it  was  not  available.  In  other 
cases  where  data  was  received,  it  was  either  incomplete  or  unusable. 
Therefore,  alternate  sources  for  data  were  sought. 

A second  source  of  data  was  the  cost  records  in  the  Cost  Library 
(ACCM)  of  the  Aeronautical  Systems  Division  (ASD)  at  Wrlght-Patterson 
Air  Force  Base.  Specifically,  the  library  has  available  the  data  used 
by  Rand  In  report  R-1693  (Large,  et  al,  1976).  Rand  .Corporation,  In 
compiling  this  data,  studied  the  available  records,  reviewed  accounting 
procedures,  and  reworked  the  data  to  provide  a consistent  base.  The 


data  need  only  be  indexed  to  a given  year  to  provide  comparability.  This 
was  done  by  J.  Watson  Noah  Associates,  Inc.  (Noah,  et  al,  1977)  in  their 
Aircraft  Cost  Handbook.  From  this  publication  were  drawn  values  for  C 
(cost)  and  Q (quantity).  The  index  year  used  was  1975.  Also,  W (weight) 
and  S (speed)  were  taken  from  this  handbook. 

All  that  remained  was  to  find  values  for  V (volume)  and  T (time). 

One  possible  source  was  the  aircraft  contracts.  Unfortunately,  many  of 
the  contracts  have  been  destroyed  and  records  of  planned  volume  and  time 
were  not  kept.  The  ASD  historian  could  not  provide  the  needed  data. 
Neither  could  the  research  department  of  the  Air  Force  Museum  at  Wright- 
Patterson  Air  Force  Base.  As  a compromise  for  the  needed  data,  planned 
acceptance  rates  and  times  as  listed  in  Assistant  Secretary  of  Defense 
(Program  Analysis  and  Evaluation)  report  Acceptance  Rates  and  Tooling 
Capacity  for  Selected  Military  Aircraft  (Office  of  Assistant  Secretary 
of  Defense  (Program  Analysis  and  Evaluation),  1974)  were  used.  This  re- 
port furnished  values  for  V (volume)  and  T (time)  in  this  study. 

Unfortunately,  all  the  required  data  were  not  available  for  all  six- 
teen aircraft  as  listed  in  Table  I.  Those  aircraft  for  which  all  data 
were  available  and  those  used  in  this  study  are  listed  in  Table  II. 

TABLE  II 

Aircraft  in  Actual  Data  Base 

,-4  A-7  F-105 

-5  F-4  F-lll 

-6  F-104  T-38 


A listing  of  the  complete  data  gathered  for  this  study  can  be  found  In 
Appendix  B. 
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MODEL  REFINEMENT 


The  model,  as  expressed  in  (6)  and  as  restated  below,  must  be  re- 
fined and  surrogate  variables  introduced  as  needed  to  facilitate  solution 


[Q(t)]  [e1 


The  first  two  terms  of  the  model  [(p/a-1)  (l-6)"aj  will  constitute  the 

first  unknown  parameter  and  will  thus  be  known  as  Bi-  The  constant  term 
A,  can  be  thought  of  as  a function  of  weight  and  speed  (A=f(W,S))  and 
will  hence  be  replaced  by  WB2S63.  The  exponent  of  Q,  (1-6),  will  be  84. 
The  exponent  of  V, (a-1 ) ( 1 -6 ) , will  be  85.  The  exponent  of  the  last  term 
( 1 — ot ) • will  be  e6.  Examination  of  these  newly  assigned  exponents  will 
reveal  that  85  = 8486-  Rewriting  the  model  in  (6)  with  the  above  sub- 
stitution yields 


C(t/V,T)  = eiW$2S63Q64VB5(epT^6-l)e6 


where 


C = discounted  program  cost  at  time  t. 

W * AMPR  weight 

S = maximum  speed  at  best  altitude 
Q = cumulative  production  experience  at  time  t 
V = volume  to  be  produced  at  T 
T = time  horizon  of  the  production  program 
p = discount  rate 


This  form  of  the  model  calls  for  discounted  program  cost  (C)  to  be  used 
The  discounted  cost  is  not  available,  and,  due  to  data  restrictions  can 


not  be  completed.  Therefore,  undiscounted  costs,  as  contained  in  the 


Rand  data,  will  be  used,  but  the  symbol,  C,  will  be  retained 
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An  undiscounted  cost  model  can  be  derived  in  much  the  same  way  as 
the  discounted  cost  model  was  derived  in  Chapter  I. 


Let  C*  be  the  undiscounted  cost.  Then 
C*  = J0T  x^)dt 

As  Womer  has  shown  (Womer :4), 


(8) 


X(t)  = A'aZa(t) 

Therefore,  substituting  into  (8) 

C*  = /0TA’aza(t)dt 

But  A"a  is  merely  a constant  (let  it  be  a ) and  Womer  (Womer :4)  has 

shown  that 

Z(t)  = Q“f t)q(t) 

Then 

c*-*/oT^(t)  TftJ* 

Following  the  substitution  by  Womer  (Womer. ... :5) 

C*  =•  aj"  Tv“(1",5)(ePT/(«-l)_1  j-a  eapt/(a-l)dt 

- ava(1“6)(ep^a"1)-1)-a(eaPt^a“1)-l)  (9) 

This  model  must  also  be  refined  and  surrogate  variables  introduced.  Let 
a = 6iW62S03,  a(i-<s)  = e4,  (a-i)  = e5  and  a = 06  (notice  that  b5  = 06-l). 
Then  (9)  can  be  rewritten 

C*  = 01We2SB3Ve4(epT/B5-l)_B6(ee6pt/a5-l)  (10) 

This  is  one  form  of  the  undiscounted  cost  model  used  in  this  thesis. 


An  alternate  form  of  the  undiscounted  cost  model  involves  a simple 

substitution.  From  Womer's  expression  for  Q (Womer :5),  it  can  be 

shown  that 

ePt/a-i  = nq/v^-^ePT/a-i.!)]  + } 

Substituting  this  expression  into  (9)  yields 

C*  . »v“(l-s)(ePt/“-i-l)-«[((Q/V)1-'s(ePT/a-I-1Hl}“-l]  („) 

This  form  of  the  undiscounted  cost  model  eliminates  t (little  t)  as  a 
decision  variable. 

This  model  must  again  be  refined  and  surrogate  variables  introduced. 
Let  a = SjW^S^3,  a(l-6)  = (a-l)  = 35,  a = g6,  and  (l -s)  ~ 67. 

(Notice  that  = g6g7  and  gs  = e6-l)-  Substituting  these  new  parameters 
into  (11)  yields 

C*  = 6i  W62s»3Vei*(epT/e5_1)-36[{(Q/v)e7ePT/65.1)+1}B6.1]  (]2) 

The  cost  models,  as  contained  in  (7),  (10),  and  (12),  are  used  in 
performing  the  analysis  reported  in  Chapter  IV. 

METHODS  OF  SOLUTION 

The  models,  as  stated  in  this  thesis,  are  to  be  evaluated  using 
least  squares  regression  analysis.  Regression  analysis  can  be  divided 
into  two  subdivisions,  linear  and  nonlinear.  A linear  model  (linear  in 
the  parameters)  is  of  the  form 


Y s B1+S2X1+B3X2+ +Bk+iXk  + e (13) 


where 


Y = dependent  variable 
X.,i=l,k  = independent  variables 

Bj,j=l,k+1  = unknown  parameters  to  be  estimated 
e = error  term 

Any  model  that  is  not  of  the  form  given  in  (13)  is  nonlinear.  The  models 
given  in  (7),  (10),  and  (12)  are  nonlinear  models;  that  is,  nonlinear  in 
the  parameters. 

There  are  essentially  three  ways  to  solve  a nonlinear  model.  These 
are  linearization,  steepest  descent  and  Marquardts1  compromise. 

The  linearization  method  makes  use  of  a Taylor  series  expansion  of 
the  model,  dropping  the  nonlinear  terms.  This  linear  representation  of 
the  model  is  then  regressed  using  linear  regression  techniques  yielding 
an  estimate  of  the  unknown  parameters.  This  procedure  is  iterated  until 
the  sum  of  squares  reaches  a minimum.  For  example,  consider  the  model 

Y = f (X , e ) + e (14) 

where 

Y = dependent  variable 

X = set  of  independent  variables 
S = set  of  parameters 
e = error  term 

Let  &Q  be  an  initial  estimate  for  0.  This  estimate  may  be  an  intelli- 
gent guess  or  preliminary  value  based  on  theory  or  available  data.  A 
Taylor  series  expansion  of  the  function  f(X,B)  using  the  initial  values 
for  0 can  be  written 
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05) 


f(x,e)  = f(x,60)  * .1  [ 1^-  ] e-B0<sre1o) 

Since,  in  regression,  the  set  of  independent  variables,  X,  are  a known 
quantity,  the  expression  in  (14)  is  now  linear  in  the  parameters  as  the 
higher  order  terms  of  the  Taylor  series  expansion  are  ignored.  Let 

F°  = f(X,Uo),  a constant  term 
Z?  = [ — — ] 6=  e , a constant  term 

1 o p-j  0 

3°  = B-  - 3- 

pl  pl  pio 

then  (15)  can  be  expressed 

f(X,B)  = F°  + £ (16) 

Substituting  (16)  into  (14)  and  rearranging  yields 

V-f°  * T * e (17) 

(-1  1 1 

which  has  the  standard  form  of  the  linear  regression  model.  This  expres 
sion  may  be  evaluated 

6°  - (Z'Z)-lZ'(Y-F°) 

giving  a revised  estimate  of  the  parameters,  B.  This  new  estimate  is 
substituted  in  the  sum-of-squares  function 

k 

SS(b)  = I [Y.-f.(X.B)]2  (18) 

i=l  1 1 

and  the  above  process  is  iterated  until  the  sum-of-squares  function  is 
minimized  or  until  the  relative  change  in  the  parameters  between  the  cur 
rent  iteration  and  the  previous  iteration  is  less  than  some  small,  pre- 
determined tolerance. 
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There  are  several  drawbacks  to  this  method  (Draper,  et  al , 1966: 
269).  First,  it  may  converge  very  slowly  and  a great  number  of  iterations 
may  be  necessary  to  reach  the  stopping  criteria.  Second,  it  may  oscil- 
late, continually  reversing  direction  and  often  increasing,  as  well  as 
decreasing,  the  sum-of-squares  function.  Third,  it  may  not  converge  at 
all. 

The  steepest  descent  method  begins  with  the  sum-of-squares  function 
given  in  (18).  The  method  starts  with  the  first  partial  derivatives  of 
the  sum-of-squares  function,  SS(e),  and  evaluates  them  at  the  starting 
point,  bq.  This  set  of  numbers  is  the  gradient  and  always  points  away 
from  a minimum  in  its  vicinity  (local  minimum).  A move  is  made  from  the 
initial  parameter  estimates,  Bq,  in  the  direction  of  the  negative  grad- 
ient, thus  moving  toward  a minimum.  If  the  estimate  of  the  parameters 
is  corrected  by  the  negative  gradient  at  each  iteration,  a minimum  will 
be  reached  eventually.  At  the  minimum,  the  gradient  will  be  zero.  This 
procedure  will  converge,  but  it  may  do  so  at  a very  slow  pace  (Draper, 
et  al,  1966:271). 

"Marquardts1  method  represents  a compromise  between  the  lineari- 
zation (or  Taylor  series)  method  and  the  steepest  descent  method  and 
appears  to  combine  the  best  features  of  both  while  avoiding  their  most 
serious  limitations"  (Draper,  et  al , 1966:272).  Basically  the  method 
starts  at  a certain  point  in  the  parameter  space, e.  The  steepest  des- 
cent method  is  applied  and  a vector  direction,  6g,  is  obtained,  where  g 
stands  for  gradient.  <5g  represents  the  best  local  direction  to  move,  but 
may  not  be  the  best  overall  direction.  The  best  direction,  however,  lies 
within  90°  of  5g.  The  linearization  method  yields  another  vector, 6.  The 
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angle  <t>  between  6g  and  6 lies  in  the  range  80°  < <j>  < 90°.  The  Marquardt 
algorithm  interpolates  between  6g  and  6 finding  the  optimum  path  to 
minimize  the  sum-of-squares  function  (Draper,  et  al,  1966:272-273). 

SPSS 

The  Statistical  Package  for  the  Social  Sciences  (SPSS)  is  a set  of 
computer  subprograms  to  facilitate  the  statistical  analysis  of  data.  One 
of  these  subprograms  is  called  NONLINEAR  and  is  used  for  nonlinear  regres- 
sion analysis.  This  subprogram  has  the  option  of  applying  two  methods, 
linearization,  known  as  the  Gauss'  method,  and  Marquardts'  method,  to 
problems  of  nonlinear  regression. 

This  subprogram  was  used  extensively  in  this  study  and  represents 
the  principle  means  of  achieving  nonlinear  regression. 


III.  STATISTICAL  BACKGROUND 


This  chapter  has  two  main  purposes.  First,  it  discusses  the  treat- 
ment of  the  error  term  in  the  models  used.  Secondly,  it  outlines  the 
statistical  procedures  used  in  evaluating  the  regression  analysis. 
Treatment  of  Error  Term 

The  models  used  in  this  thesis  are  of  the  nonlinear  type  with  addi- 
tive error  term.  Such  models  are  of  the  general  form 

Y = f(X,e)  + e 


where 

Y = dependent  variable 

X^,i  = l,k  = independent  variables 

= l,k+l  = parameters  to  be  estimated 
e = error  term 

The  error  term  is  considered  to  be  normally  distributed  with  mean  equal 
to  0 and  variance  equal  to  a2.  This  is  usually  written:  e N(0,a2). 
"Calculation  of  the  statistical  properties  of  the  regression  equations 
requires  an  additive  error"  (Levenson,  et  al,  1971:37).  Hence,  this  form 
of  the  error  term  has  been  adopted. 

Statistical  Procedures 

There  are  two  problems  associated  with  the  statistical  evaluation 
of  the  models  presented  in  this  thesis.  First,  "the  usual  tests  which 
are  appropriate  in  the  linear  model  case  are.  In  general,  not  appropriate 
when  the  model  is  nonlinear"  (Draper,  et  al,  1966:282).  There  are  no 
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specific  statistical  tests  of  the  nonlinear  model  found  in  this  research. 
Therefore,  the  usual  linear  tests  will  be  used,  bearing  in  mind  that  the 
test  results  are  not  absolute  but  merely  guides  as  to  the  statistical 
merit  of  the  particular  solutions  being  tested  (Robinson,  1977:21). 

The  second  problem  is  that 

"the  standard  statistics  that  are  used  to  evaluate  regression 
models  (e.g.,  coefficient  of  correlation,  standard  error  esti- 
mate) do  not  give  direct  statements  regarding  the  ability  of 
the  model  to  predict  future  observations.  They  indicate  how 
well  the  model  fits  the  data"  (Levenson,  et  al,  1971:39). 

The  solution  to  this  problem  requires  a measure  that  makes  a probability 
statement  about  the  confidence  that  can  be  placed  in  a prediction.  There- 
fore, use  will  be  made  of  prediction  intervals.  "Prediction  intervals  are 
limits  within  which  the  value  of  a single  future  observation  lies  with  a 
specified  probability"  (Levenson,  et  al,  1971:39). 

The  statistical  tests  used  in  this  thesis  are  defined  below.  These 
tests  give  a relative  relationship  of  the  "goodness  of  fit"  of  the  model 
and  establish  relative  error  bounds  on  predictions.  The  statistics  in- 
clude: 

MSE 

R2 

t statistic 
F statistic. 

Mean  Squared  Error  Is  an  unbiased  estimator  of  the  model's  vari- 
ance. It  is  obtained  by  dividing  the  sum-of-squares  for  error  (SSE)  by 
the  degrees  of  freedom. 

n . SSE 

MSE  = (Y1-Yi)2  - fTTT 
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where 


Yj,1=l,n  = dependent  variable 

A 

Y.j,i=l,n  = regression  estimator  of  Yi 

n = number  of  observations 
k = number  of  parameters  estimated 
SSE  = sum-of-squares  for  error 


In  model  evaluation,  a small  variance  is  desired  and  indicative  of  good 

explanatory  and  predictive  ability. 

The  Coefficient  of  Determination  measures  how  well  the  explanatory 

variables  account  for  the  variations  in  the  actual  cost  data.  That  is, 

R2  measures  the  proportion  of  total  variation  about  the  mean  of  Y that  is 

explained  by  the  regression.  Thus 

n 


R2 


I(YrY.)2 
i=l  1 1 

I (Yr?)2 
i=l  1 


SSE 
' SST 


where 

Y.,  i=l  n = dependent  variable 

1 9 

A 

Yj,  1*1, n * regression  estimator  of  Y^ 

? = average  of  dependent  variables 
SSE  = sum-of-squares  for  error 
SST  = total  sum  of  squared  deviations  about  the  mean 
NOTE:  In  a model  containing  an  additive  constant  term,  SST=SSR+SSE  where 
SSR  * sum-of-squares  for  regression.  In  a model  without  an  additive  con- 
stant term,  this  relationship  does  not  hold.  The  models  used  in  this 
thesis  do  not  have  an  additive  constant  term. 


/•pPPfc 

t* 
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Therefore,  in  this  context,  R2  takes  on  a different  meaning  and  can  only 
be  used  as  a basis  for  comparison. 
t Statistic 

The  Students'  t statistic  is  the  ratio  of  a standard  normal  random 
variable  divided  by  the  square  root  of  a X2  random  variable  which  was 
divided  by  its  degree  of  freedom.  This  statistic  is  used  to  determine 
the  significance  of  an  individual  parameter  and,  also,  is  used  in  the 
computing  of  confidence  intervals  and  prediction  intervals.  The  test  for 
significance  of  an  individual  parameter  is  as  follows: 


H0:B 
Hx  :6 


i 

i 


= 0 
* 0 


T 


Vei 


vWj| 


Reject  H0  if  |T|  > to/2 

where 


bn-  = the  parameter  being  tested 

S2(XxX)Tj  = ii  entry  of  the  variance-covariance  matrix 
t , = Students'  t statistic  for  two  tailed  test 

a = confidence  level  of  the  test. 


To  construct  a (l-a)  confidence  interval  for  b^ , the  statistic  is  used 

b,  ± to/2 


Similarly,  a (l-a)  prediction  interval  for  Y (cost)  is  constructed 

* 1 v* 
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where 


s2  = S2X*(x'x)"x'  + S2 

X*  = values  for  independent  variables  for  which  a prediction 
is  desired. 

This  form  of  the  prediction  interval  assumes  a one  to  one  corres- 
pondence between  the  number  of  parameters  and  the  number  of  independent 
variables.  In  a nonlinear  model,  this  correspondence  does  not  necessarily 
hold.  Therefore,  an  alternative  method  is  necessary.  The  first  partial 
derivatives  with  respect  to  the  parameters  are  taken.  Substituted  into 
the  first  partials  are  the  values  for  the  independent  variables  for  which 
a prediction  is  desired  (X*  from  above).  Additionally,  the  values  for  e 
determined  by  the  regression  analysis  are  substituted.  This  results  in 
a vector  of  scalars  representing  the  first  partials  at  the  point  X*. 

This  vector  is  £.  Let 

G = V<1  Vg.  + S2' 

where 

£ = vector  of  first  partials 
V = variance-covariance  matrix 
S2  = variance  in  the  model. 

The  prediction  interval  is  then 

* 1 V* 6 

where 

tay2  is  defined  above. 

In  using  the  t statistic  In  the  context  of  a nonlinear  model  with 
no  additive  constant  term.  It  must  be  assumed  that  the  model  Is  nearly 
linear  in  the  parameters  at  the  final  parameter  estimates. 
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F Statistic 


The  F distribution  is  the  ratio  of  two  X2  random  variables  divided 
by  their  respective  degrees  of  freedom.  It  is  used  to  compare  the  rela- 
tive merit  of  the  full  model  against  that  of  a restricted  model  in  which 
some  of  the  ' s are  zero.  The  test  is  stated 

H0  : restricted  model  is  better  model 
Hj  : restricted  model  is  not  better  model 

SSEr-SSE 

Fo  = — isf-  ~ F (r»  n_k) 
n-k 

Reject  H0  if  Fo  > F 

where 

SSEr  = sum-of-squares  for  error  of  a model  in  which  linear 
restrictions  have  been  placed  on  the  parameters 
SSE  = sum-of-squares  for  error  In  the  same  model  without 
the  restriction 

r = the  number  of  linear  restrictions  imposed 
n = number  of  data  points 

k = the  number  of  parameters  in  unrestricted  model. 
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IV.  ANALYSIS 


The  analysis  concerns  the  comparison  of  the  Womer  model  as  repre- 
sented in  equation  (7)  to  several  other  models  of  the  same  type  as  they 
are  regressed  on  the  same  data  base.  The  Womer  model  will  be  referred  to 
as  Model  I in  this  chapter. 

When  the  Womer  model,  as  stated  in  (7),  is  linearly  constrained 
such  that  3s  and  36  are  zero,  the  model  becomes 

C = 3iW$2S63Qe4  (19) 

This  is  the  model  used  by  Levenson  (Levenson,  et  al,  1971)  and  will  form 
the  base  case  against  which  the  Womer  model  is  compared.  This  is  Model 
II. 

Substituting  T for  the  exponential  term  of  the  Womer  model  yields 

C = 3iWe2SB3QB4VB5TB6  (20) 

which  is  a model  that  can  be  reduced  to  log-linear  form  and  analyzed  by 
linear  means.  This  is  the  model  used  by  Dunne  (Dunne,  1975)  and  is  re- 
ferred to  as  Model  III  in  this  chapter.  The  interpretation  of  the  pjra- 
meters  3i  through  35  is  the  same  as  in  the  Womer  model.  The  interpretation 
of  36  is  unclear  and  this  model  is  only  considered  due  to  its  simplicity 
and  previous  use  by  Dunne. 

The  undiscounted  cost  versions  of  the  Womer  model  constitute  Models 
IV  and  V.  Equation  (10)  will  be  called  Model  IV  and  equation  (12)  will 
be  called  Model  V.  All  five  models  are  summarized  in  Table  III. 
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T = time  horizon  for  the  program 
V = volume  of  output  to  be  produced  by  T 
p = discount  rate 


The  first  data  base  considered  for  analysis  consisted  of  52  points. 
These  points  were  chosen  on  the  basis  of  the  planned  acceptance  schedule 
in  effect  at  the  time  the  research  and  development  contract  for  each  air- 
craft was  signed.  The  time  T was  measured  from  the  date  of  the  earliest 
plan  listed  in  the  Acceptance  Rates  and  Tooling  Capacity  for  Selected 
Military  Aircraft  study  (Office  of  Assistant  Secretary  of  Defense  (Program 
Analysis  and  Evaluation),  1974).  Likewise,  the  time  to  produce  quantity  Q 
aircraft  was  measured  from  the  time  of  the  earliest  schedule  to  time  of  Q 
actual  acceptances.  This  measure  presents  some  problems.  Acceptance 
lags  behind  production  and,  therefore,  the  time  given  is  probably  larger 
than  the  actual  time  taken  to  produce  quantity  Q aircraft.  No  other  reli- 
able measures  of  time  to  produce  quantity  Q aircraft  were  available  and 
this  unknown  error  must  be  accepted.  This  set  of  data  is  referred  to  as 
Data  Set  I.  A listing  of  the  data  used  is  given  in  Appendix  C.  The  dis- 
count rate  of  10%  was  chosen  in  accordance  with  Air  Force  Regulation 
178-1  (Department  of  The  Air  Force,  1973:11).  Table  IV  summarizes  the 
results  of  the  regression  analysis  using  this  data  base. 

From  the  results,  it  is  noted  that  R2  is  quite  high  which  is  indi- 
cative of  a good  fit  and  none  of  the  models  distinguishes  itself  of  the 
basis  of  R2.  The  returns  to  scale  parameter,  a,  is  greater  than  one  but 
less  than  two,  which  is  the  value  to  be  expected  in  the  aerospace  industry. 
This  value  represents  moderately  decreasing  returns  to  scale.  The  slope 
of  the  learning  curve  for  all  the  models  except  IV  is  relatively  close  to 
the  empirically  derived  80%  slope  which  characterizes  the  aerospace 
Industry  (Large,  et  al,  1976:29).  It  should  also  be  noted  that  the 


small  magnitude  of  Si  is  due  to  the  scaling  of  the  Independent  variable. 


I 

I 


TABLE  IV 

RESULTS  OF  REGRESSION  ANALYSIS 
DATA  SET  I 


Model 


Parameters 

I 

II 

III 

IV 

V 

Bi 

.00002 

.00002 

.00021 

.00687 

.00002 

32 

1.2186 

1.0902 

1.2029 

1.6236 

1.1435 

B3 

.4438 

.4970 

.4360 

-.9573 

.4448 

34 

.6448 

.6529 

.6445 

.3785 

.6916 

&5 

.0528 

.0471 

.7055 

.3283 

36 

-.0820 

-.6485 

1.7055 

1 .3283 

37 

.5206 

a 

1 .0820 

- 

1.0731 

1 .7055 

1 .3283 

<S 

.3552 

.3471 

.3555 

.7781 

.4794 

Learning 
Curve  Slope 

78.18% 

78.61% 

78.16% 

58.31  % 

71.72% 

Statistical 

Results 

df 

47 

48 

46 

47 

47 

SSE 

5.2E+05 

5.8E+05 

5.2E+05 

1.2E+06 

5.3E+05 

MSE 

1.1E+04 

1 . 2E+04 

1.1E+04 

2.6E+04 

1.1E+04 

R2 

.99 

.99 

.99 

.97 

.99 

Due  to  its  small  size,  Bi  was  not  statistically  different  from  zero  when 
95%  confidence  intervals  were  computed  for  all  the  parameters.  In  Model 
I,  e6  was  also  not  statistically  different  from  zero  at  the  a = .05  con- 
fidence level. 

The  F test,  as  presented  in  Chapter  III,  was  applied  to  Models  I 
and  II  with  Model  II  being  the  restricted  model.  With  an  F0  = 4.55,  the 
null  hypothesis  that  the  restricted  model  is  the  better  model  is  rejected 
at  a confidence  level  of  a = .05.  In  comparing  Model  II  to  Model  III, 

F0  = 2.64  and  the  null  hypothesis  that  the  restricted  model  is  the  better 
model  is  not  rejected. 

Additional  regressions  were  made  with  the  discount  rate  as  a deci- 
sion parameter.  With  Model  I,  the  optimal  value  of  the  discount  rate  to 
minimize  the  sum  of  squares  was  8.57%.  Applying  the  same  procedure  to 
Model  IV  produced  a discount  rate  of  15.36%.  Model  V produced  incon- 
clusive results. 

To  be  most  effective,  the  Womer  model  requires  that  actual  production 
follow  the  designated  plan.  The  existing  data  set  of  52  points  was  re- 
examined and  those  points  where  t (time  to  product  quantity  Q airframes) 
exceeded  T (time  horizon  for  the  program)  were  immediately  eliminated. 

The  remaining  points  were  then  examined  for  "reasonableness".  "Reason- 
ableness" was  determined  by  looking  at  the  average  planned  production  per 
month  (V/T)  and  average  actual  production  (Q/t).  The  rate  of  production 
to  complete  V (volume  of  output  to  be  produced  by  T)  was  then  calculated 
( (V-Q)/T -t ) ) . If  the  rate  of  production  to  complete  V was  near  the 
planned  production  per  month  or  if  the  rate  of  production  to  complete  V 
did  not  exceed  33,  the  point  was  considered  reasonable. 
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This  procedure  reduced  the  number  of  data  points  to  30.  This  set 
is  Data  Set  II  and  a listing  is  provided  in  Appendix  D. 

This  new  data  set  was  regressed  and  analyzed  in  the  same  manner 
as  Data  Set  I.  The  discount  rate  remained  at  10%.  The  results  of  this 
analysis  appear  in  Table  V. 

Upon  examining  the  Table,  the  change  in  discount  rate  for  Model  I 
is  immediately  apparent.  This  model  on  Data  Set  II  would  not  converge 
for  discount  rates  less  than  15%.  No  plausible  reason  can  be  given  for 
this  failure  to  converge.  The  SPSS  algorithm  for  nonlinear  least  squares 
does  seem  to  be  sensitive  to  the  initial  starting  values  and  contents  of 
the  data  base. 


mnnB 


The  overall  performance  of  the  models  on  Data  Set  II  was  not  too 
different  from  that  on  Data  Set  I except  for  MSE.  MSE  was  one  magnitude 
lower  on  Data  Set  II  which  means  less  unbiased  variance.  The  results  of 


Data  Set  II  should  provide  better  explanatory  and  predictive  ability  for 
programs  that  follow  this  plan. 

The  F test  was  again  applied  to  Models  I and  II  yielding  F0  of  3.48 
and  Models  II  and  III  yielding  F0  of  2.74.  In  neither  case  can  the  null 
hypothesis  that  the  restricted  model  is  the  better  model  be  rejected  at 


a confidence  level  of  a = .05.  This  leads  to  conflicting  results.  The 
improvement  of  the  Womer  model  over  the  restricted  model  on  Data  Set  II 
is  not  statistic  significant  at  the  5%  level  yet  it  is  on  Data  Set  I. 
Model  III  likewise  In  either  case.  Unfortunately,  due  to  the  lack  of  a 
one  to  one  correspondence  between  the  parameters  in  Models  IV  and  V and 
the  restricted  model,  as  represented  by  II,  Models  IV  and  V cannot  be 


subjected  to  the  F test 


Left  unanswered  is  the  question  as  to  which  model  is  best.  Per- 
haps an  analysis  of  the  predictive  ability  of  the  models,  as  presented 
in  Chapter  V,  will  shed  some  light  on  this  issue. 
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TABLE  V 


RESULTS  OF  REGRESSION  ANALYSIS 
DATA  SET  II 


Model 


Parameters 

I* 

II 

III 

IV 

V 

6i 

.00007 

.00019 

.03220 

.00246 

.0009 

62 

1.1728 

.8264 

1.7635 

2.1118 

.9119 

63 

.4179 

.6185 

.1422 

-1 .3818 

.5859 

64 

.6215 

.5985 

.6739 

.3630 

.6228 

65 

.0019 

.0557 

.2611 

.2148 

6e 

-.0031 

-2.5779 

1 .2661 

1.2148 

67 

.5126 

a 

1.0031 

- 

1 .0826 

1.2611 

1.2148 

6 

.3785 

.4015 

.3261 

.7122 

.4874 

Learning 
Curve  Slope 

7692% 

75.70% 

79.77% 

61.03% 

71.33% 

Statistical 

Results 

df 

25 

26 

24 

25 

25 

SSE 

1.3E+05 

1 .4E+05 

1 .2E+05 

2.0E+05 

1.4E+05 

MSE 

5.1E+03 

5.5E+03 

4.9E+03 

7.8E+03 

5.7E+03 

R2 

.96 

.95 

.97 

.94 

.96 

♦Discount  Rate  of  15%  used. 
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V.  MODEL  VALIDITY 


The  true  test  of  a cost  estimation  model  is  in  its  ability  to  pre- 
dict future  costs.  A model  is  valid  only  to  the  extent  that  it  can 
accurately  predict.  Chapter  IV  gave  an  indication  as  to  how  well  the 
various  models  fit  the  data.  In  this  chapter  the  models  will  be  used 
in  an  attempt  to  estimate  the  costs  of  other  airframes. 

Models  and  Airframes  Used 

Based  on  an  assessment  of  the  models  presented  in  Chapter  IV,  three 
were  chosen  for  prediction  analysis.  These  models  were  chosen  as  a re- 
sult of  their  statistical  properties  and  are  representative  of  all  the 
models  used  in  this  study.  The  models  selected  were  Model  I,  Womer  dis- 
counted cost  model,  Model  II,  Levenson  or  constrained  Womer  model,  and 
Model  V,  Womer  undiscounted  cost  model. 

The  airframes  chosen  for  prediction  analysis  were  the  F-14  and  F-15. 
These  airframes  were  chosen  for  two  reasons.  First,  they  are  the  newest, 
state  of  the  art  aircraft  in  the  Navy  and  Air  Force  inventory.  They  are 
representative  of  future  aircraft  for  which  cost  predictions  may  be  sought. 
Secondly,  and  perhaps  more  importantly,  sufficient  data  was  available  on 
these  aircraft  to  justify  a prediction  analysis.  The  data  came  from  two 
sources.  Cost,  quantity,  weight,  and  speed  information  was  furnished 
by  J.  Watson  Noah  Associates,  Inc.,  through  their  Aircraft  Cost  Hand- 
book (Noah,  et  al,  1977).  Values  for  volume  and  time  were  taken  from 
production  plans  and  delivery  schedules  furnished  by  the  contractors. 

These  schedules  can  be  found  in  Appendix  E.  The  data  used  appear  in 
Table  VI. 
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TABLE  VI 


PREDICTION  DATA 


AIRCRAFT 

ACTUAL  COST 

WEIGHT 

SPEED 

QUANTITY 

VOLUME 

TIME 

(Mil.  75$) 

(lbs) 

(knots) 

(months) 

F-14 

1050.833 

26,016 

1370 

86 

469 

111 

F-15 

1032.353 

17,364 

1319 

112 

749 

116 

Prediction  Results 

Cost  predictions  were  made  for  the  F-14  and  F-15  airframes  using 
the  three  models  listed  above.  Predictions  are  made  using  the  parameters 
determined  by  regression  analysis  on  both  Data  Sets  I and  II.  The  pre- 
diction results  are  summarized  in  Table  VII.  Prediction  error  is  the 
absolute  difference  between  the  actual  and  predicted  cost. 

In  Table  VII,  the  prediction  values  for  Model  I,  Data  Set  II  are 
missing.  This  is  due  to  the  fact  that  Model  I would  not  converge  on 
Data  Set  II.  No  parameters  were  estimated  and,  therefore,  no  prediction 
could  be  made. 

Examination  of  the  computed  prediction  errors  reveals  a wide  dis- 
parity in  the  predictive  ability  of  the  models,  given  the  data  set  and 
aircraft.  The  relatively  accurate  predictions  of  the  F-14  are  nullified 
by  the  Inaccurate  predictions  of  the  F-15.  Both  results  are  considered 
alarming.  No  plausable  reason  is  seen  for  this  disparity  in  results. 

Due  to  the  disparity  In  results,  average  prediction  errors  were 
computed  for  each  model  and  data  set  across  the  two  airframes.  These 
results  are  displayed  in  Table  VIII. 
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-<**3  TABLE  VII 


TABLE  VIII 


AVERAGE  MODEL  - DATA  SET 
PREDICTION  ERRORS 


I 

I 154.303 

MODEL  II  141.727 

V 140.546 


DATA  SET 


II 


86.626 

101.243 


This  Table  shows  Model  V to  be  the  best  on  Data  Set  I,  but  not  by 
much.  Model  II  is  clearly  better  on  Data  Set  II.  The  striking  difference 
is  in  the  predictive  ability  of  the  two  data  sets.  Data  Set  II  is  clearly 
superior  to  Data  Set  I.  This  could  certainly  be  attributed  to  the  care 
with  which  Data  Set  II  was  chosen. 

Having  made  this  comparison  of  averages,  an  additional  step  was 
taken.  The  average  for  each  model,  each  data  set,  and  each  airframe  was 
taken.  These  averages  were  determined  by  taking  the  average  of  the  pre- 
diction errors  across  all  the  observations  for  that  particular  item  of 
interest.  The  results  are  contained  in  Table  IX. 

TABLE  IX 

AVERAGE  PREDICTION  ERROR 

MODEL  DATA  SET 

I 154.303  I 145.525 

II  114.177  II  93.185 

V 120.145 


AIRFRAME 

F-14  66.885 

F-l 5 182.293 
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Table  IX  shows  that  Model  II  is  the  best,  but  is  not  that  much 
better  than  Model  V.  Model  II  is  clearly  better  than  Model  I.  This 
can  be  attributed  to  the  fact  that  Model  I calls  for  discounted  cost 
and  undiscounted  cost  was  used.  Data  Set  II  is  again  superior  to  Data 
Set  I and  this  result  is  again  not  surprising.  The  Womer  models  assume 
that  the  production  plan  used  is  actually  being  followed.  This  is  more 
likely  with  Data  Set  II  than  with  Data  Set  I due  to  the  way  Data  Set  II 
was  assembled.  The  surprising  result  is  the  wide  disparity  between  the 
two  airframes  and,  again,  no  plausable  reason  can  be  given  for  this 
result. 

Prediction  Intervals 

The  next  logical  step  in  the  analysis  is  the  construction  of  pre- 
diction intervals.  Before  proceeding,  however,  a few  comments  regarding 
prediction  Intervals  are  in  order. 

The  percentage  100(1 -a)  is  the  confidence  level  of  the  prediction 
interval  where  a is  the  level  of  significance.  That  is  to  say  that  if 
repeated  observations  on  the  cost  of  an  airframe,  using  the  same  inde- 
pendent variables,  were  taken,  100(1 -a)  percent  of  the  time  these  obser- 
vations would  lie  within  the  range  set  by  the  lOO(l-a)  prediction  interval. 
This  does  not  mean  that  there  Is  a 100(l-a)  probability  that  the  actual 
value  for  any  particular  observation  will  lie  within  the  interval  (Batch- 
elder,  et  al,  (1969:52).. 

"Further,  prediction  intervals  are  valid  outside  the  range  en- 
compassed by  the  sample  data  that  are  used  to  generate  the 
estimating  relationship  and  the  interval  only  If  the  estimating 
relationship  Is  Itself  valid  outside  that  range."  (Batchelder, 
et  al,  1969:52). 
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With  these  cautions  in  mind,  50%  prediction  intervals  were  con- 
structed with  the  results  displayed  in  Table  X. 

The  50%  prediction  interval  was  chosen  due  to  the  extreme  width  of 
the  intervals.  The  intervals  are  wide  because  "the  formula  for  the  pre- 
diction interval  is  such  that  the  width  of  the  interval  is  sensitive  to 
the  size  of  the  standard  error;  large  standard  errors  indicate  that  much 
of  the  cost  variation  in  the  observed  data  is  unexplained  by  the  equation" 
(Batchelder,  et  al,  1969:53).  A 50%  prediction  interval  is  not  very 
definitive;  an  interval  of  higher  percentage  would  be  meaningless. 

Even  with  the  wide  intervals  presented,  one  actual  cost  did  not 
fall  inside  the  interval.  That  one  being  the  interval  using  Model  I, 

Data  Set  I for  the  F-15.  It  should  also  be  noted  that  the  lower  limits 
of  the  intervals  for  Model  V,  Data  Set  II  were  actually  negative  and 
were  truncated  to  zero. 

Looking  closer  at  the  interval  widths,  they  range  from  518.022  to 
2387.824.  Both  extremes  are  relatively  large,  and  the  larger  the  inter- 
val width,  the  less  certainty  there  is  in  the  prediction. 

As  was  done  in  the  case  of  prediction  errors,  average  intervals 
were  computed  for  each  model  and  each  data  set  for  the  two  airframes. 

These  computations  appear  in  Table  XI. 


♦Actual  interval  width  was  wider  than  listed.  Lower  bound  of  prediction  interval  was  truncated  at 
zero. 


TABLE  XI 


i 


AVERAGE  MODEL  - DATA  SET 
PREDICTION  INTERVALS 


MODEL 


DATA  SET 

I II 

I 619.642 

II  610.586  1791.395 

V 592.554  2104.329 


Table  XI  contradicts  the  results  of  Table  VIII  in  that  Data  Set  I 
is  superior  to  Data  Set  II.  No  conclusive  results  can  be  drawn  concerning 
the  models. 

The  average  interval  width  for  each  model,  each  data  set,  and  each 
airframe  was  computed  next.  These  averages  were  derived  by  taking  the 
average  of  the  interval  widths  across  all  the  observations  for  each  item 
of  interest.  These  averages  are  listed  in  Table  XII. 


TABLE  XII 

AVERAGE  INTERVAL  WIDTH 


MODEL 

DATA  SET 

AIRFRAME 

I 619.642 

I 607.594 

F-14  1282.099 

II  1201.113 

II  1947.784 

F-l 5 1005.241 

V 1348.241 
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The  results  of  Table  XII  are  somewhat  the  opposite  of  those  of 
Table  IX.  Here  Model  I gives  the  smallest  average  prediction  interval 
width;  Data  Set  I is  far  superior  to  Data  Set  II;  and  the  F-15  gives 
the  smallest  average  prediction  interval  width.  In  terms  of  model,  data 
set,  and  airframe,  that  combination  which  gives  the  most  accurate  pre- 
diction also  has  the  most  unexplained  variance  when  it  comes  to  pre- 
diction intervals.  In  terms  of  models  alone,  the  model  with  the  best 
prediction  ability  does  not  give  the  smallest  prediction  interval.  The 
model  with  the  smallest  average  prediction  intervals  gives  the  worst 
average  point  estimate  of  the  total  cost.  These  contradictory  results, 
combined  with  the  results  of  Chapter  IV,  make  an  accurate  and  unbiased 
evaluation  of  the  models  difficult  and  frustrating. 


VI.  SUMMARY 


This  thesis  represents  an  effort  to  explain  the  future  based  on  the 
results  of  the  past.  It  enters  into  the  uncertain  world  of  cost  pre- 
diction. Only  time  can  truly  validate  a model  and,  unfortunately,  by  the 
time  the  model  is  validated  it  no  longer  has  value  as  a predictor. 

The  historical  development  of  parametric  cost  estimation  models  for 
aircraft  airframes  has  relied  on  three  variables:  weight,  speed,  and  quan- 
tity. Past  efforts  to  explain  airframe  costs  using  other  variables  have 
been  fruitless  (Large,  et  al,  1976).  This  study  used  a microeconomic 
production  function  augmented  with  the  learning  hypothesis  and  traditional 
CER  variables  of  weight  and  speed.  By  doing  so,  it  takes  into  account  the 
time  flow  of  airframe  production  and,  thus,  provides  a means  to  optimize 
the  production  process. 

For  the  program  manager,  airframe  weight  and  aircraft  speed  are 
fixed.  Therefore,  volume  and  time,  as  incorporated  by  the  models  in  this 
study,  are  the  only  manageable  variables  in  the  cost  equation.  By  using 
volume  and  time  as  decision  variables,  the  manager  gains  greater  control 
over  total  program  cost.  By  varying  volume  and  time  within  the  moael , he 
can  determine  the  effect  of  program  changes  on  total  cost.  This  can  be 
important  in  an  acquisition  process  where  change  is  the  rule  rather  than 
the  exception. 

Conclusion 

The  results  of  this  study  are  confusing  and  contradictory.  They 
reflect  the  uncertainty  that  is  Inherent  in  all  cost  prediction.  No 
model  is  entirely  without  fault;  no  method  without  uncertainty.  In  the 


words  of  Voltaire,  "Doubt  is  not  a pleasant  mental  state,  but  certainty 
is  a ridiculous  one."  With  this  in  mind,  an  attempt  will  be  made  to 
arrive  at  a conclusion. 

The  analysis  in  Chapter  IV  seems  to  indicate  that  the  simplest  is 
best.  The  Womer  model  as  developed  in  Chapter  I was  statistically  better 
than  the  Levenson  model  (or  restricted  Womer  model  as  developed  in  Chap- 
ter IV)  in  only  one  case.  However,  it  must  be  remembered  that  the  Womer 
undiscounted  cost  model  could  not  be  statistically  compared  to  the 
Levenson  model.  Chapter  IV  did  demonstrate  the  importance  of  data  to 
the  analysis.  When  the  more  carefully  chosen  data  set  (Data  Set  II)  was 
used,  results,  particularly  MSE,  did  improve.  The  data  used  in  this  study 
was  anything  but  optimal  and  many  concessions  were  made  in  its  use. 

The  predictions  in  Chapter  V were  far  from  conclusive.  The  appa- 
rent accuracy  of  some  predictions  was  offset  by  the  inaccuracy  of  others. 
No  model  clearly  distinguished  itself. 

It  is,  therefore,  the  conclusion  of  this  study  that  the  more  com- 
plicated Womer  model  is  no  better  than  the  less  complex  Levenson  model. 

The  best  predictors  of  aircraft  airframe  cost  still  appear  to  be  weight, 
speed,  and  quantity. 

Recommendations 

The  conclusions  of  this  thesis  should  in  no  way  inhibit  future  study 
in  the  area  of  aircraft  airframe  cost  prediction  and  analysis.  The  basis 
of  the  Womer  model  seems  sound  and  reasonable.  To  use  just  three  vari- 
ables to  estimate  the  future  cost  of  something  so  complicated  as  an  air- 
frame seems  absurd.  It  seems  reasonable  to  assume  that  each  airframe 


47 


would  have  its  own  learning  curve  and  returns  to  scale.  A future  study 
might  investigate  this  point  and  attempt  to  estimate  costs  on  a less 
aggregate  basis. 

Also,  as  has  been  stated  several  times,  the  data  used  in  this  study 
could  be  improved  upon.  With  better,  more  reliable  data,  the  results 
could  be  entirely  different.  As  a second  recommendation,  it  is  suggested 
that  the  study  be  reaccomplished  using  a different  data  base. 


BIBLIOGRAPHY 


AFR  178-1.  Economic  Analysis  and  Program  Evaluation  for  Resource 
Management.  Washington:  Department  of  the  Air  Force,”  December  1973. 

Asher,  Harold.  Cost-Quantity  Relationships  in  the  Airframe  Industry 
(R-291 ) . Santa  Monica,  California:  The  Rand  Corporation,  July  1956. 

Batchelder,  C.A.  An  Introduction  to  Equipment  Cost  Estimating  (RM- 
6103-SA).  Santa  Monica,  California!  The  Rand  Corporation,  December 
1969. (AD  702  424). 

Draper,  N.R.  and  H.  Smith.  Applied  Regression  Analysis.  New  York, 

New  York:  John  Wiley  & Sons,  Inc.,  1966. 

Dreyfuss,  David  J.  and  Joseph  P.  Large.  Estimated  Costs  of  Extended 
Low-Rate  Airframe  Production  (R-2243-AF).  "Santa  Monica.  California: 

The  Rand  Corporation,  March  1978. 

Dunne,  William  E.  Microeconomic  Theory  Applied  to  Parametric  Cost 
Estimation  of  Aircraft  Airframes^  MSThesis.  Wright- Patterson  AFB, 
Ohio: Air  Force  Institute  of  Technology,  December  1975. 

Grauer,  C.A.  and  H.E.  Boren,  Jr.  Multivariate  Logarithmic  and 
Experimental  Regression  Models  (RM^4879-PrT!  Santa  Monica,  California: 
The  Rand  Corporation,  July  1967. (AD  655  768) . 

Intri legator,  M.D.  Mathematical  Optimization  and  Economic  Theory. 
Englewood  Cliffs,  New  Jersey:  Prentic-liall , 1971. 

Large,  Joseph  P.,  et  al_.  Production  Rate  and  Production  Cost  (R-1609- 
PA&E).  Santa  Monica,  California:  The  Rand  Corporation,  December  1974. 
TADA009  074). 

Large,  Joseph  P.,  et  al . Parametric  Equations  for  Estimating  Air- 
craft Airframe  Costs  TR-16^3-1-PA&E) . Santa  Monica,  California: 

The  Rand  Corporation,  February  1976.  (AD  A002  086). 

Large,  J.P.  and  K.M.S.  Gillespie.  A Critique  of  Aircraft  Airframe 
Cost  Models  (R-2194-AF).  Santa  Monica,  California:  The  Rand  Corp- 
oration, September  197/. 

Levenson,  G.S.  et  al . Cost-Estimating  Relationships  for  Aircraft 
Airframes  (R-76T^~PRT.  Santa  Monica,  California:  The  Rand  Corporation, 
December  1971.  (AD  891  956). 

Marcotte,  Ronald  C.  Aircraft  Airframe  Cost  Estimation  Utilizing  A 
Components  at  Variance  Model . MS  Thesis'!  Wright-)>atterson  A^B,  Ohio: 
Air  Force  Institute  of  Technology,  October  1976. 


48 


i "-V  . 


BIBLIOGRAPHY  (cont'd) 


i 


14.  Marquardt,  Donald  W.  "An  Algorithm  for  Least-Squares  Estimation  of 
Nonlinear  Parameters",  Journal  of  Industrial  Applied  Mathematics,  Vol 
431-441  (June  1963). 

15.  Mendenhall,  William  and  Richard  L.  Schaeffer.  Mathematical  Statistics 
With  Applications.  North  Scituate,  Massachusetts!  Duxbury  Press, 

1973. 

16.  Nie,  Norman  H.,  et  al_.  SPSS.  New  York,  New  York:  McGraw-Hill  Book 
Company,  1975. 

17.  Noah,  J.  Watson,  et  aj_.  Aircraft  Cost  Handbook.  Alexandria,  Virginia: 
J.  Watson  Noah  Associates,  Inc.,  January,  1977. 

18.  Office  of  Assistant  Secretary  of  Defense  (Program  Analysis  and  Eval- 
uation). Acceptance  Rates  and  Tooling  Capacity  for  Selected  Military 
Aircraft.  “Washington,  D.C.:  Department  of  Defense,  October  1974. 

(AD  A011  501). 

19.  Petruschell,  R.L.  Some  Curve-Fitting  Fundamentals  (RM-5766-SA) . 

Santa  Monica,  California:  The  Rand  Corporation,  December  19687 
(AD  680  613). 


20.  Robinson,  Barry.  SPSS  Sub] 

pro1 

qram  NONLINEAR-Nonl inear  Regression 

Evanston,  Illinois:  Vogel  1 

bac 

k Computing  Center,  August  T 97^ . 

21.  Timson,  F.S.  and  D.  P.  Tihansky.  Confidence  in  Estimated  Airframe 
Costs:  Uncertainty  Assessment  in  Aggregate  Predictions  (R-903-PR) . 
Santa  Monica,  California:  The  Rand  Corporation,  October  1972. 

(AD  757  503). 

22.  Theil,  Herri . Pr i nci pi es  of  Econometri cs . New  York,  New  York: 

John  Wiley  & Sons,  Inc,  1971. 

23.  Womer,  Norman  Keith.  Learning  Curves,  Production  Rate  and  Program 
Costs.  Unpublished  paper.  Wright-Patterson  AFB,  Ohio:  Air  Force 
Institute  of  Technology,  1977. 

24.  Womer,  Norman  Keith.  "Learning  Curves,  Production  Rate,  and  Program 
Costs:  An  Illustration  of  Results",  Proceedings  of  the  Seventh 
Annual  Acquisition  Research  Symposium,  pp  83-55.  Hershey,  Penn- 
sylvania: Federal  Acquisition  Institute,  May  1978. 


i 

1 


49 


APPENDIX  A 


July  24,  1978 


Fairchild  Republic  Company 
Public  Relations 

Farmingdale,  Long  Island,  New  York  11735 
Dear  Sir: 

As  a student  at  the  Air  Force  Institute  of  Technology,  I am  presently 
collecting  data  to  be  used  in  a master's  thesis  effort.  The  thesis  in- 
volves an  airframe  cost  estimation  model  in  which  production  rate  is  a 
decision  variable.  In  order  to  carry  out  my  research,  I need  data  on 
the  planned  (not  actual)  volume  and  production  rate  for  various  air 
frames . 

To  assure  uniformity,  I am  requesting  that  the  data  be  taken  from  the 
first  production  contract  planning  documents  and  be  effective  as  of  the 
date  of  the  signing  of  the  first  production  contract.  Specifically,  I 
need  the  planned  number  of  airframes  to  be  produced  and  the  planned  pro- 
duction schedule  for  those  airframes  broken  down  by  month,  if  possible. 

I am  requesting  the  above  data  on  the  A-10,  F-105  weapons  systems. 

Please  send  the  data  to  my  thesis  advisor.  Dr  N.  Keith  Womer,  and  he  will 
forward  it  to  me.  The  address  is: 

Dr  N.  Keith  Womer 
AFIT/ENS 

Wright-Patterson  AFB,  Ohio  45433 

Thank  you  for  your  time  and  your  consideration  is  very  much  appreciated. 
Sincerely, 


John  A.  Long 
Capt,  USAF 
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APPENDIX  B 


COMPLETE  DATA  SET 


QJST  WEIGHT 


SPEEO 


QUANT  VOLUME 


5072 
50  7 2, 
5072 
5072 
5072 
5072 
5072, 
5072 
5072 
5072 
5072 
22500 
22500, 
72500 
22500 
22500 
22500, 
16400, 
16400, 
16400 
15400, 
16400, 
16400, 
16400, 
15400, 
11521, 
11521, 
11621, 
11621, 
11521, 
11621 
11621, 
11521, 


11621 
11621 
11621 
17  520 
17320 
17320 
17320 

17320 

17321 
17320 
17320 

7954 

7054 

7954 

7954 

7954 


»C*T 

MIT 

HEIGHT 

SPEEO 

OUANT 

VOL  UN  E 

TINE 

4.038 

7954. 

1150. 

0. 

650. 

71. 

*-184 

100.506 

7954. 

1150. 

19. 

650. 

71. 

*-104 

550.035 

7954. 

1150. 

006. 

650. 

71. 

r-lH 

655.037 

7954. 

1150. 

069. 

650. 

71. 

*-t04 

703.303 

7954. 

1150. 

090. 

650. 

71. 

*■-184 

4.033 

7954. 

1150. 

0. 

044. 

39. 

*-184 

100.505 

7954. 

1150. 

19. 

044. 

39. 

*-104 

550.533 

7954. 

1150. 

000. 

044. 

39. 

*-104 

4.033 

7954. 

1150. 

0. 

719. 

64. 

*-104 

100.506 

7354. 

use. 

19. 

719. 

64. 

*-104 

550.333 

7954. 

1150. 

000. 

719. 

64. 

*-104 

655.037 

7954. 

1150. 

069. 

719. 

64. 

*-184 

703.35  3 

7954. 

1150. 

090. 

719. 

64. 

*-184 

4.033 

7354. 

1150. 

0. 

1330. 

70. 

*-104 

100.105 

7954. 

1150. 

19. 

1330. 

70. 

*-104 

450.533 

7954. 

1150. 

000. 

1330. 

70. 

*-104 

655.057 

7354. 

1150. 

069. 

1330. 

70. 

*-104 

703.353 

7954. 

1150. 

090. 

1330. 

70. 

*-105 

316.337 

19439. 

1195. 

15. 

056. 

45. 

*-105 

855.640 

19439. 

1195. 

00. 

056. 

45. 

*-105 

1136.477 

19439. 

1195. 

100. 

056. 

45. 

*-105 

1403.570 

19439. 

1195. 

176. 

056. 

45. 

*-105 

316.337 

19439. 

1195. 

IS. 

76. 

45. 

*-185 

316.937 

19439. 

1195. 

15. 

15. 

50. 

*-105 

316.997 

19439. 

1195. 

15. 

1107. 

104. 

*-184 

055.540 

19439. 

1195. 

00. 

1107. 

104. 

*-105 

1136.477 

19439. 

1195. 

100. 

1107. 

104. 

*-105 

1403.370 

19439. 

1195. 

176. 

1107. 

104. 

*-105 

1004.777 

19439. 

1195. 

315. 

1187. 

104. 

*-105 

0300.049 

19439. 

1195. 

495. 

1107. 

104. 

*-104 

316.997 

19439. 

1199. 

15. 

363. 

90. 

*-to« 

055.540 

19439. 

1195. 

00. 

363. 

90. 

*-105 

1136.477 

19439. 

1195. 

100. 

363. 

90. 

*-105 

1403.570 

19439. 

1195. 

176. 

963. 

98. 

*-105 

1609.777 

19439. 

1195. 

315. 

363. 

90. 

*-105 

0300.043 

19439. 

1195. 

495. 

963. 

90. 

*-105 

316.997 

19439. 

1195. 

15. 

1301. 

104. 

*-105 

655.640 

19439. 

1195. 

SO. 

1301. 

104. 

*-185 

1136.477 

19439. 

1195. 

100. 

1301. 

104. 

*-105 

1403.570 

19439. 

1195. 

176. 

1301. 

104. 

*•105 

1009.777 

19439. 

1195. 

315. 

1301. 

104. 

*-105 

0300.949 

19439. 

1195. 

495. 

1301. 

104. 

*-111 

490.944 

30450. 

1060. 

10. 

1706. 

110. 

•-lit 

0165.940 

30450. 

1060. 

159. 

i7f;4. 

110. 

*-111 

0377.979 

30450. 

1060. 

103. 

1706. 

lit. 

•-111 

3169.330 

30450. 

1060. 

079. 

1706. 

lit. 

*-111 

3904.010 

30450. 

1060. 

373. 

1704. 

lit. 

•-111 

4330.170 

30450. 

1060. 

431. 

1706. 

lit. 

*-tll 

440.144 

30450. 

1060. 

16. 

1174. 

106. 

*-111 

0165.940 

30450. 

1060. 

159. 

1174. 

104. 

*-111 

0377.479 

30456. 

1060. 

163. 

1174. 

106. 

•err 

C3IT 

WEIGHT 

SPEEO 

QUANT 

VOLUME 

TIME 

*-tu 

3169.139 

32658. 

1262. 

279. 

1176. 

106. 

*-m 

3909. 010 

32658. 

1262. 

373. 

1176. 

106. 

*-m 

9330. ira 

32658. 

1262. 

631. 

1176. 

106. 

T-1A 

31.998 

5366. 

750. 

2. 

368. 

77. 

r-js 

60.9*9 

5366. 

750. 

6. 

77. 

T-1$ 

116.898 

5366. 

750. 

19. 

368. 

77. 

T-38 

239.917 

5366. 

750. 

69. 

368. 

77. 

r-n 

390.179 

5366. 

750. 

213. 

360. 

77. 

T-n 

936.783 

5366. 

750. 

357. 

360. 

77. 

t-to 

31. *68 

5366. 

750. 

2. 

106. 

T-l« 

61. 989 

5366. 

750. 

6« 

sot! 

100. 

r-u 

116.898 

5366. 

750. 

19. 

800. 

100. 

r-is 

239.917 

5366. 

750. 

69. 

000. 

100. 

T-H 

398.179 

5366. 

750. 

213. 

800. 

100. 

r-« 

936.783 

5366. 

750. 

357. 

80S. 

108. 

r-sa 

31.688 

5366. 

750. 

2. 

793. 

95. 

T -18 

68.999 

5366. 

750. 

6. 

793. 

95. 

t-to 

116.998 

5366. 

750. 

19. 

95. 

T-38 

239.817 

5366. 

750. 

69. 

793. 

95. 

T-38 

398.179 

5366. 

750. 

213. 

793. 

95. 

r-sa 

536.763 

5366. 

750. 

357. 

793. 

95. 

Cost  (C)  • - cumulative  undiscounted  production  cost  in  million  75$ 

Weight  (W)  - AMPR  weight  in  pounds 
Speed  (S)  - maximum  speed  at  best  altitude  in  knots 

Quant  (Q)  - cumulative  quantity 

Volume  (V)  - total  planned  production 
_ Time  (T)  - total  lengtff'of  production  period  in  months 


Source  of  Cost,  Weight,  Speed,  Quantity: 

Noah,  J.  Watson,  et  al_.  Aircraft  Cost  Handbook.  Alexandria, 
Virginia:  J.  Watson  Noah  Associates,  Inc.,  January  1971. 

Source  of  Volume,  Time: 

Office  of  Assistant  Secretary  of  Defense  (Program  Analysis  and 
Evaluation),  Acceptance  Rates  and  Tooling  Capacity  for  Selected 
Military  Aircraft.  Washington,  bC:  Department  of  Defense, 
October  1974. 
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APPENDIX  C 
DATA  SET  I 

i : . " 

I t 

I 

l 


4C*T 

rjjr 

HEIGHT 

SPEED 

QUANT 

VOL  UN E 

TIME 

TIHEO 

(4 

n. nr 

5072. 

570. 

1. 

520. 

63. 

23. 

0-4 

io5.no 

5072. 

576. 

20. 

520. 

63. 

44. 

«D 

re. in 

5072. 

576. 

10. 

520. 

63. 

30. 

240.013 

5072. 

570. 

72. 

520. 

63. 

52. 

4-4 

365.503 

5072. 

976. 

166. 

120. 

63. 

57. 

*-4 

422.124 

5072. 

576. 

236. 

520. 

63. 

66. 

} 

4-5 

230.120 

22000. 

1147. 

11. 

193. 

90. 

32. 

4-5 

iso. srr 

22100. 

1167. 

25. 

193. 

96. 

50. 

1 -1 

237.231 

2200  0 • 

1167. 

77. 

193. 

90. 

73. 

4-9 

920.231 

22000. 

1147. 

97. 

193. 

96. 

60. 

f 

4-4 

1060.0  1 0 

22000. 

1147. 

120. 

193. 

96. 

90. 

> 

4-4 

72.554 

16400. 

563. 

5. 

190. 

91. 

20. 

• 

4-4 

192.552 

10400. 

563. 

17. 

190. 

91. 

60. 

€ 

4-4 

274.030 

16400. 

563. 

20. 

190. 

91. 
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tcrr  CUT  HEIGHT  SPEED  0U9NT  VOLUME  TIME  TXMEO 

T-19  536.7,3  >346.  750.  357.  793.  95.  99. 


Cost  (C) 
Weight  (W) 
Speed  (S) 
Quant  (Q) 
Volume  (V) 
Time  (T) 
TlmeQ  (t) 


- cumulative  undiscounted  production  cost  in  million  75$ 

- AMPR  weight  in  pounds 

- maximum  speed  at  best  altitude  in  knots  ! 

- cumulative  quantity 

- total  planned  production 

- total  length  of  production  period  in  months  \ 

- time  in  months  to  accept  quantity  Q airframes  , 

1 


Source  of  Cost,  Weight,  Speed,  Quantity: 


Noah,  J.  Watson,  et  al_.  Aircraft  Cost  Handbook.  Alexandria, 
Virginia:  J.  Watson  Noah  Associates,  Inc.,  January  1971. 


Source  of  Volume,  Time,  TimeQ: 

Office  of  Assistant  Secretary  of  Defense  (Program  Analysis  and 
Evaluation),  Acceptance  Rates  and  Tooling  Capacity  for  Selected 
Mil itary  Aircraft.  Washington,  bt:  Department  of  Defense, 
October  1974. 
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APPENDIX  D 
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Cost  (C) 
Weight  (W) 
Speed  (S) 
Quant  (Q) 
Volume  (V) 
Time  (T) 
TlmeQ  (t) 


- cumulative  undiscounted  production  cost  in  million  75$ 

- AMPR  weight  in  pounds 

- maximum  speed  at  best  altitude  in  knots 

- cumulative  quantity 

- total  planned  production 

- total  length  of  production  period  in  months 

- time  in  months  to  accept  quantity  Q airframes 


Source  of  Cost,  Weight,  Speed,  Quantity: 

Noah,  J.  Watson,  et  al_.  Aircraft  Cost  Handbook.  Alexandria, 
Virginia:  J.  Watson  Noah  Associates,  Inc.,  January  1971. 

Source  of  Volume,  Time,  TlmeQ: 


Mil  . 


Office  of  Assistant  Secretary  of  Defense  (Program  Analysis  and 
Evaluation),  Acceptance  Rates  and  Tooling  Capacity  for  Selected 
Military  Aircraft.  Washington,  DC:  Department  of  Defense,  October 
1974. 
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